Truncated Log-concave Sampling for Convex Bodies with Reflective Hamiltonian Monte Carlo

نویسندگان

چکیده

We introduce Reflective Hamiltonian Monte Carlo (ReHMC), an HMC-based algorithm, to sample from a log-concave distribution restricted convex body. prove that, starting warm start, the walk mixes target $\pi(x) \propto e^{-f(x)}$, where $f$ is $L$-smooth and $m$-strongly-convex, within accuracy $\varepsilon$ after $\widetilde O(\kappa d^2 \ell^2 \log (1 / \varepsilon))$ steps for well-rounded body $\kappa = L m$ condition number of negative log-density, $d$ dimension, $\ell$ upper bound on reflections, parameter. also developed efficient open source implementation ReHMC we performed experimental study various high-dimensional data-sets. The experiments suggest that outperfroms Hit-and-Run Coordinate-Hit-and-Run regarding time it needs produce independent introduces practical truncated sampling in thousands dimensions.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Sampling from a log-concave distribution with compact support with proximal Langevin Monte Carlo

This paper presents a detailed theoretical analysis of the Langevin Monte Carlo sampling algorithm recently introduced in Durmus et al. (2016) when applied to log-concave probability distributions that are restricted to a convex body K. This method relies on a regularisation procedure involving the Moreau-Yosida envelope of the indicator function associated with K. Explicit convergence bounds i...

متن کامل

Sampling from a log-concave distribution with Projected Langevin Monte Carlo

We extend the Langevin Monte Carlo (LMC) algorithm to compactly supported measures via a projection step, akin to projected Stochastic Gradient Descent (SGD). We show that (projected) LMC allows to sample in polynomial time from a log-concave distribution with smooth potential. This gives a new Markov chain to sample from a log-concave distribution. Our main result shows in particular that when...

متن کامل

Hamiltonian Monte Carlo sampling for Wishart distributions with eigenvalue constraints

Sampling from constrained target spaces for Bayesian inference is a non-trivial problem. A recent development has been the use of Hamiltonian Monte Carlo in combination with particle re ection, see [Pakman and Paninski, 2014]. However, Hamiltonian Monte Carlo is sensitive to several hyper parameters, that need to be tuned, to ensure an ecient sampler. For this purpose, [Wang et al., 2013] sugge...

متن کامل

Exact Hamiltonian Monte Carlo for Truncated Multivariate Gaussians

We present a Hamiltonian Monte Carlo algorithm to sample from multivariate Gaussian distributions in which the target space is constrained by linear and quadratic inequalities or products thereof. The Hamiltonian equations of motion can be integrated exactly and there are no parameters to tune. The algorithm mixes faster and is more efficient than Gibbs sampling. The runtime depends on the numb...

متن کامل

Markov Chain Monte Carlo posterior sampling with the Hamiltonian method

The Markov Chain Monte Carlo technique provides a means for drawing random samples from a target probability density function (pdf). MCMC allows one to assess the uncertainties in a Bayesian analysis described by a numerically calculated posterior distribution. This paper describes the Hamiltonian MCMC technique in which a momentum variable is introduced for each parameter of the target pdf. In...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: ACM Transactions on Mathematical Software

سال: 2023

ISSN: ['0098-3500', '1557-7295']

DOI: https://doi.org/10.1145/3589505